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We propose a new method for detecting a charged (pseudo-) scalar at colliders, based upon the ob- 
servation that its Yukawa coupling to charm and bottom quarks can be large due to a significant 
mixing of the top and charm quarks. After analyzing the typical flavor mixing allowed by low 
energy data in the topcolor and the generic two-Higgs doublet models, we study the physics po- 
tential of the Tevatron, LHC, and linear colliders for probing such an s-channel charged resonance 
via the single-top (as well as W h°) production. We show that studying its detection at collid- 
ers can also provide information on the dynamics of flavor-changing neutral current phenomena. 
PACS number(s): 13.85.Ni 12.60.Fr f4.65.Ha f4.80.Cp [MSUHEP-8080f] 



The large mass of the top quark (t) suggests that it 
may play a special role in the dynamics of the elec- 
troweak symmetry breaking (EWSB) and/or the flavor 
symmetry breaking. The topcolor models [QJ|] and the 
supersymmetric theories with radiative breaking ||] are 
two of such examples, in which the Higgs sector gener- 
ically contains at least two (composite or fundamental) 
scalar doublets, and hence predicts the existence of phys- 
ical charged (pseudo-)scalars as an unambiguous signal 
beyond the standard model (SM). We point out that a 
large flavor mixing (FM) between the right-handed top 
and charm quarks can induce a large FM Yukawa cou- 
pling of a charged (pseudo-) scalar with charm (c) and 
bottom (b) quarks. This is different from the usual 
Cabibbo-Kobayashi-Maskawa (CKM) mixing which in- 
volves only left-handed fermions in the charged weak cur- 
rent. Furthermore, when the neutral scalar (</>°) and the 
charged scalar (</> ± ) form an SU(2) doublet, the weak 
isospin symmetry connects the flavor-changing neutral 
coupling (FCNC) (ffi-t-c to the flavor-mixing charged cou- 
pling (FMCC) (jr^-c-b through the CKM matrix. Hence, 
a direct measurement of the FMCC at high energy col- 
liders can also provide information on the FCNC, which 
may give better constraint than that inferred from the 
low energy kaon and bottom physics. 

In this Letter, we show that with a large FMCC ± -c-6, 
cjy^ can be copiously produced via the s-channel partonic 
process cb, cb — > ^ at colliders, such as the Fermilab 
Tevatron, CERN Large Hadron Collider (LHC) and elec- 
tron/photon linear colliders (LCs). After analyzing the 
production rates of (ft^ as a function of its mass and 
its coupling strength to the c and b quarks, we discuss 
the typical range of these parameters (allowed by the low 
energy data) in the topcolor model (TopC) JJlJ] and the 
generic two-Higgs doublet model (2HDM) |Q,|[7 We show 
that with a significant mixing between the right-handed 



top and charm quarks, a sizable coupling of 



-b can 



be induced from a top-mass-enhanced cjr^-t-b Yukawa 
coupling, so that Tevatron can probe the charged top- 
pion mass up to ~ 300-350GeV in the TopC model, LHC 
can probe the mass-range of charged Higgs bosons up to 



~ O(l) TeV, and the high energy 77 LCs can also be 
sensitive to such a production mechanism. 

s-Channel Production of Charged (Pseudo-)Scalars 

With a large FM coupling of (jr^-c-b, it is possible to 
study the charged scalar or pseudo-scalar cjr^ via the par- 
tonic s-channel production mechanism, cb, cb — > (j> . 
Defining the q-q'-cjr^ coupling as ClL + CrR in which 
L(R) = (l=F75)/2, we derive the total cross section for <f> + 
production at hadron colliders as 

a (h^icb) -> <t>+X) = ^ (\C L \ 2 + \C R \ 2 ^ ^ 



dy 
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and f q /h{x, Q ) is the parton distribution func- 
tion (PDF) with Q the factorization scale (chosen as m^). 
Similarly, we can derive the cross section formula for 
e~e + (77) — > <p + cb and 77 — > <j) + cb at electron and 
photon linear colliders. For the e~e + process we have 
used the Williams- Weizsacker equivalent photon approx- 
imation. The present analysis for the signal event is con- 
fined to the tree level, and the CTEQ4L PDFs are used 
for hadron collisions. The complete next-to-leading order 
(NLO) QCD correction (including the 6(c)-gluon fusions) 
will improve the numerical results but will not change our 
main conclusion p]. 

To illustrate the <f> production rates at various collid- 
ers, we consider its Yukawa couplings to be the typical 



values of TopC models [cf. eqs. (§{7|) below]: Cf = Cf = 
and Cfl = ytotanfl, Cr ~ C$ x 0.2, with y w = \/2m t /v, 
tan/3 ~ 3 and v ~ 246 GeV, which serves as a benchmark 
of our general analysis. In Fig. 1 we plot the s-channel 
resonance cross section versus the mass of <fi at hadron 
and electron/photon colliders. For = 200 [1000] GeV 
at the 1.8 and 2 TeV Tevatron [14 TeV LHC], the total 
cross sections are 2.7 and 4.0 [0.55] pb, respectively. The 
production rates, calculated from a complete gauge in- 
variant set of c-b fusion diagrams, are also large at the 
7-7 LCs. [Here, we do not include the production of <f> - 
pair with one scalar decaying into be, whose cross section 
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is large for <§; \/~S/2.} It is trivial to rescale our 
results to other values of Cl,r- For instance, the typi- 
cal couplings of the generic 2HDM [cf. eqs. (§|l(j)] are 
Cf = Cf ~ and = C# ~ $ x 9%. Taking the 
sample value f|£ ~ 1.5, we find that a typical prediction 
of this 2HDM can be obtained from rescaling the solid 
curves in Fig. 1 by a factor of 1/19. 
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FIG. 1. The s-channel ^-production with the benchmark 
parameter choice of TopC models. As a reference, dashed 
curves show the results at Tevatron (2 TeV), LHC and 77 LCs, 
with top-pion Yukawa couplings satisfying the roughly esti- 
mated 3a i?i,-bound M (reanalyzed with new R^ p data). 
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FIG. 2. tb invariant-mass distribution of charged top-pion 
production, with its Yukawa coupling constrained by the es- 
timated 3<t _R(,-bound. The (solid, dashed, dotted) curves are 
plotted for Cr = Cf x (0.33,0.2,0.11), corresponding to 3 
typical values of Ir-cr mixing parameter K^f R in eq. (6). 

For m<f, > 190 GeV, the dominant decay mode of ^ 



can be the tb pair, which is the case for TopC-type of 
models (cf. Fig. 3). Therefore, (ft^ may be detected via 
single-top production. The ± production rate at the 
Tevatron drops very fast for > 300 GeV and becomes 
comparable with the SM s-channcl single-top rate, via 
qq' -> W* -► tb,ib. [The NLO W* rate is about 0.70, 
0.86 and 11.0 pb at the 1.8, 2 TeV Tevatron and the 
14 TeV LHC, respectively. Although the i-channel single- 
top rate (via Wg fusion) is larger j|] , its event topology is 
different from the s-channel single-top event. Therefore, 
we only compare the <jr^ signal rate with the W* rate.] 
Thus, an analysis on the distribution of the t-b (or W-b- 
b) invariant mass will ensure the identification of ^ due 
to its resonance peak (cf. Fig. 2). The Tevatron Run I 
data (at 1.8 TeV) may already put important bounds on 
some parameter space of m^, and Cl,r- 

Flavor- Mixing and Top-pion n t Production in TopC 



The topcolor scenario [jl|j8| is attractive because it ex- 
plains the large top quark mass and provides possible dy- 
namics of the EWSB. Such type of models generally pre- 
dict light composite (pseudo-)scalars with large Yukawa 
coupling to the third family. This induces distinct new 
FM phemonena which can be tested at both low and 
high energies. In the typical topcolor-I class of mod- 
els |u|, three light pseudo-scalars, called top-pions, are 
predicted with masses around of O(150 — 300)GeV. The 
up(down)-type quark mass matrices Mxj{Mjj) exhibit an 
approximate triangular texture due to the generic top- 
color breaking pattern pTcj] . For generality, we can write 



Mr, 




(2) 



where the small non-diagonal pieces = 0(e 4 )i>, 

£3,4 = 0(e)v and thus the 33 element m' t is very close 
to the physical top mass m t . Here, e = 0(($)/Ao), 
with Ao being the breaking scale of a larger group 
down to the topcolor group, and the vacuum expecta- 
tion value ($) being the topcolor breaking scale. So, 
we expect e < 1. A proper rotation of the quarks 
from weak eigenstates into mass eigenstates will diag- 



onalize M\j and Md, so that 



Kl L MuK UR = 



and 



kUtMdKdr = M*, from which the CKM matrix can 
V = K) 



be derived as 



ul K D l ■ We show that it is pos- 
sible to construct a realistic but simple pattern of the 
left-handed rotation matrices Kjjl and Kol such that 
(i) the Wolfenstein-parametrization |llj of CKM is re- 
produced, (ii) Cabibbio-mixing is mainly generated from 
Kdl while the mixings between the 3rd and 2nd families 
are mainly from Kjjl, (iii) all dangerous contributions 
to low energy data (such as the K—K, D—D and B— B 
mixings and the b — *■ 57 rate) can be evaded. In fact, the 
point (ii) may help to explain the successful empirical re- 
lations A U md I m s and V c b ~ yjm c /m t , where A is 
the Wolfenstein-parameter. By introducing the unitary 
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matrices Kjjl and Kol, 

(1 \ / S^Cg s^sgy 

c -sx , K DL = I -s^ c^ce c^sgy | 
sx* c J \ -y*sg c e 

with |x| = |y| = 1 and + c? = 1, we find the solution 
to reproduce Wolfenstein-parametrization up to 0(A 3 ): 

c,c e - 1 + 0(A 4 ), c = l-A 2 /2, s = A + O(A 3 ), 

= A 2 ^[(l - pf + ry 2 ] 1 ^, s , = A 2 A[p 2 + ry 2 ] 1 ^ 

x= (l-p + z?/)/[(l- /9 ) 2 + 7 ? 2 ] 1 /2 i y=(p-+Tj)/\fW] l/2 , 

, (4) 

where A ~ 0.22, A ~ 0.82, and vV + ?7 2 ~ 
0.43. Given the matrices Mu, Kul and the known 
Af^ la =diag(m u , m c , rnt), the right-handed rotation ma- 
trix Kuft is constrained, and the matrix elements 



K tt 

^UR 



'UR 



(5) 



For the reasonable values of Smt = m t — m' t = 0(1 
10 GeV), (g) gives 



A, 



0.99-0.94 , Klj c R < 0.11-0.33 



(6) 



which shows that the tu-CR transition can be natu- 
rally around 10-30%. [It also requires £1,2 (= 0(e 4 )v) — 
O(GeV), which suggests e = O(0.2 - 0.4).] Since the 
mass hierarchy in the down-quark sector is much smaller 
than that in Mu, the mass pattern of is taken to 
be less restrictive. It is easy to check that the above 
Kul,dl arid Kjjr satisfy the requirement of the point 
(iii), in contrast to the naive VCKM-ansatz [ [U)| , (The 
b — > S7 rate also has a contribution C' 7 {Mw) depending 
on Kjjr p0[ - Since the pattern of Md is less certain 
in this model, we take K b Q R more or less free, e.g., a 
simple V CKM-ansatz for Kdr can already accommodate 

S7]cxp 



BR[6^ s 7 ] exp data JTOj . ) 

The relevant FM vertices including the large £r-cr 
transition for the top-pions can be written as 



m t tanS 



liv UR 



Kt}*t L t R n?+V2Kt};K b D b L t R b L n+ 



(7) 



where tan/3 = y/(v/v t ) 2 - 1 and v t ^ O(60 - 100) GeV 
is the top-pion decay constant. An important feature is 
that the charged top-pion ir t mainly couples to the right- 
handed top (£#) or charm (cr) but not the left-handed 
top (it) or charm (cl), in contrast to the standard W-t- 
b coupling which involves only t^. Note that ir^ also 
has a topcolor-instanton induced coupling with t^, of 
the strength \f2m* b jv t 0, which is much suppressed by 
m\ < mi, -C v t . The tiny left-handed rotation element 
\Kp L \ = s « 2 - 4% [cf. (§)-(|)] further makes the C£-& fl 
coupling to nf negligible. Hence, the produced top quark 
from cjr^-t-b interaction is close to hundred percent right- 
handed polarized, and measuring the top polarization in 



the single-top event provides further identification of the 
signal. Eq. (^) suggests that the neutral top-pion 7r° can 
be produced in association with the single-top via charm- 
gluon fusion, i.e., eg, eg — > trf, tn®. However, due to the 
limited Tevatron energy, the t-ir^ production is only fea- 
sible at the LHC. This is similar to a study |H| for the 
2HDM, but a much larger signal rate for 7r° is expected 
because of the enhanced ir® Yukawa coupling. Typically, 
for rn^i > mt +TO(,, the main decay channels of irf 1 are tb 
and cb. The total decay width and the branching ratios 
(BRs) of irf are shown in Fig. 3, separately, in which we 
have assumed that the tb and cb pairs are the only two 
available decay channels of tv^ up to 1 TeV, though the 
top-pion is not expected to be very heavy. [Note that 
the mass splitting m^± — m^o may be larger than Mw 

in certain parameter region so that 7r^ — > Wit® channel 
can become important as well. This will make the pat- 
tern of BRs for 7Tj -decay similar to that of 7? ± -decay in 
the 2HDM (cf. Fig. 3b).] From Figs. 1 and 3, we can 
estimate the single-top event rates at various colliders. 
For the 1.8 and 2.0 TeV Tevatron [14 TeV LHC] with 0.1 
and 2 [100] ftr 1 luminosity and = 200 [500] GeV, we 
find the numbers of single t and t events to be 153 and 
4.5 x 10 3 [1.4 x 10 6 ], while for the 0.5 [1.0] TeV photon- 
photon (77) LC with a 50 [500] fb _1 luminosity the rate 
becomes 2.9 x 10 3 [1.2 x 10 4 ] for m = 200 [500] GeV. 
(If top decays scmilcptonically, a branching ratio of 21% 
for t — > bW{-^ £vg), with £= eor/i, should be included.) 
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FIG. 3. Total decay widths (a) and branching ratios (b) 
of irf in the TopC model (solid), and of tf* in the 2HDM 
(dashed) for the typical parameter choice in the text. 



Flavor-Mixing and Charged Higgs Production in 2HDM 

The 2HDM is the simplest extension of the SM and 
its supersymmetrization results in the popular minimal 
supersymmetric SM (MSSM). In contrast to the MSSM, 
the general 2HDM has potentially dangerous tree-level 
flavor-changing neutral currents. Under the reasonable 
ansatz for the structure of the Higgs Yukawa couplings 
[cf . (|l0|)] , the pattern for the FM Yukawa couplings may 
be naturally generated from the quark-mass hierarchy, 
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which sufficiently suppresses the FCNC for the light gen- 
erations while predicting significant mixings between the 
charm and top quarks. The generic 2HDM considered 
here is called "type-Ill" [§J||, which does not make use 
of the ad hoc discrete symmetry |T^] . The FM Yukawa 
couplings can be conveniently formulated under a proper 
basis of Higgs doublets such that (<&i) = (0,u/\/2) T and 
($2) = (0, 0) T . Thus, the diagonalization of the fermion 
mass matrix also diagonalizes the Yukawa couplings of 
$1, and all the FM couplings are generated by $2- The 
Yukawa interaction of the quark sector can be written as 



-C q 
j -y 



V2 



+ 



h.c. 



(8) 



Here the Higgs boson states are (H°, H^A , H ± ) and the 
CP-even neutral states (H^H^) rotate into the mass 
eigenstates (h°,H°), characterized by the mixing angle 
a. The t-b-H ± and c-b-H ± interactions are: 



H+^{Y^V) tb b L - 
H+[cr- (Y^V) cb b L 



t L (VY D ) tb b R ] 
-cZ(VY D ) cb b R 



h.c. 



(9) 



where Y U(D) = Kj {D)L Y uw K u(D)R and V is CKM ma- 
trix. The couplings Y¥' D thus contain all new FM effects 
and exhibit a natural hierarchy under the ansatz [Q,^| 



Y 



U,D 



(10) 



with _ Q shows that the t _ c 

or c-t transi- 
tion gives the largest FM coupling while the FMs with- 
out involving the top quark are highly suppressed by 
the light quark masses. Such a suppression is shown 
to persist at high energy scales according to a recent 
renormalization group analysis |f4T| . From (^) and (10), 



we deduce (Y*V) cb ~ Y%*V tb + Y%*V cb ~ Y t u c * and 



(VYo) 



Y< 



D « Yg*. 



Therefore, the dominant FM ver- 



tex c-b-H^ involves cr&l but not cj]3 R . It was found 
H that low energy data allow ~ 0(1) and re- 

quire rrih H < m± < or < m± < m^H, 
where m± is the mass of H and mi lt H,A the masses 
of (h°,H°,A°). (The Higgs mixing angle a is not con- 
strained.) For m± > m t + m b , H can decay into the tb 
and cb pairs. If m± > Mw+rrih or m± > Mw+tua, then 
additional decay channels, such as — > W^h , W^A , 
should also be considered. The total decay width and 
the branching ratios of for a typical parameter set of 
(£%,€g) = (1, 1.5), m h = 120 GeV, m A > m± and a = 
are shown in Fig. 3, separately. [We have verified that 
the choice of = 1 is consistent with the current 3<r 
i?b-bound for m± > 120 GeV. Choosing a larger value of 
£|£ > 1 will simutaneously increase (reduce) the BR of tb 
(Wh°) mode.] At the 14TeV LHC with a 100 ftr 1 lumi- 
nosity and for m = 300 [800] GeV, about 1.3 x 10 5 [384] 
single-top and 1.8 x 10 5 [4.1 x 10 3 ] Wh° events will be pro- 
duced, while the 0.5 [1.0] TeV 77 LC with a 50 [500] fb" 1 



luminosity can produce about 52 [131] single-top and 
73 [545] Wh° events for m = 300 [500] GeV. From 
Fig. 3b, we note that the tb and the W^hP decay modes 
are complementary in low and high mass ranges of H^, 
though the details may depend on the values of (m^, mj) 
and a. Therefore, in this model it is possible to detect 
i7 ± in either the single-top or the W7i°(— > bb, tt) event. 

In summary, the s-channel production mechanism pro- 
posed in this work provides a unique probe of the charged 
(pseudo-)scalars at the hadron and electron/photon col- 
liders. We focus on probing the s-channel charged scalar 
or pseudo-scalar via single-top production (as well as 
W ± h°), which is generic for the TopC model and the 
type-Ill 2HDM. For other models (such as supersymmet- 
ric theories), the leptonic decay channel (e.g., rv r mode) 
may become significant as well, and thus should be in- 
cluded. At the upgraded Tevatron, we show that under 
the typical flavor-mixing pattern of the TopC models, 
the charged top-pion mass can be explored up to ~300- 
350 GeV; while the LHC can probe the charged Higgs 
mass up to - 0{1) TeV for the 2HDM. The linear col- 
liders, especially the 77 collider, will be effective for this 
purpose even at its early phase with \/S = 500 GeV. 
For the MSSM, supersymmetry forbids tree-level FCNCs, 
and the small FMCCs are described by the usual CKM 
mixings. However, a large FMCC may be induced at the 
loop level, depending on the soft-breaking parameters of 
the model. Work along this line is in progress. 
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